Astronomy &: Astrophysics manuscript no. fdflae'astroph 
(DOI: will be inserted by hand later) 



February 5, 2008 



Lya emission galaxies at a redshift of z ?^ 5.7 in the FORS 

Deep Field * 



C. Tapkeni'3, I. Appenzeller\ A. Gabasch^'^, J. Heidt^ U. Hopp^'"^, R. Bender^'^, D. Mehlert^, S. Noll^ 

S. Seitz2'4, and W. Seifert^ 



\0' 
O 

o 

(N 

<: 

(N 



> 

(N 

O 

o 

O 



% 



^ Landessternwarte Heidelberg-Konigstuhl, D-69117 Heidelberg, Germany 

^ Universitats-Sternwarte Miinchen, Scheinerstr. 1, D-81679, Miinchen, Germany 

^ Max-Planck-Institut fiir Astronomie, Konigstuhl 17, D-69117 Heidelberg, Germany 

^ Max-Planck-Institut fur extraterrestrische Physik, Giessenbachstr., D-85741 Garching, Germany 

received; accepted 

Abstract. We present the results of a search for Lya emission galaxies at z ~ 5.7 in the FORS Deep Field. The 
objective of this study is to improve the faint end of the luminosity function of high-redshift Lya emitting galaxies 
and to derive properties of intrinsically faint Lya emission galaxies in the young universe. Using F0RS2 at the 
ESO VLT and a set of special interference filters, we identified candidates for high-redshift Lya galaxies. We 
then used F0RS2 in spectroscopic mode to verify the identifications and to study their spectral properties. The 
narrow-band photometry resulted in the detection of 15 likely Lya emission galaxies. Spectra with an adequate 
exposure time could be obtained for eight galaxies . In all these cases the presence of Lya emission at z = 5.7 
was confirmed spectroscopically. The line fluxes of the 15 candidates range between 3 x 10~^^Wm~^ and 16 x 
10~^^Wm~^, which corresponds to star-formation rates not corrected for dust between 1 and 5 M0yr~^. The 
luminosity function derived for our photometrically identifled objects extends the published luminosity functions 
of intrinsically brighter Lya galaxies. With this technique the study of high-redshift Lya emission galaxies can 
be extended to low intrinsic luminosities. 
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1. Introduction 

The frequency and the physical parameters of high- 
redshift galaxies provide important constraints on the for- 
mation and evolution of these objects. Strong Lya emis- 
sion allows detection of Lya emission galaxies (LAEs) at 
high redshift from their excess in narrow-band filters (e.g. 
Kudritzki et al. WM Rhoads et al. ISDPUl Steidel et al. 
I^nnni Fynbo et al. HUU^ Venemans et al.'JODlI)- Apart from 
drop-out -selected galaxies (e.g., Lehnert & Bremer 1^0031 
Bunker et al. l2UU4|l . our knowledge of the z > 5 galaxies is 
based on objects detected as emitters of strong Lya radi- 
ation. Well-defined gaps in the telluric OH-bands allow to 
detect LAEs rather efficiently at very high redshifts (Hu et 
ahUPS" Taniguchi et al. [2003b: Maier et al. 2003: Ajiki ct 
al. 170031 Rhoads et al. 1^03. Taniguchi et al. J005, Wang 
et al. 120051 for a review see Taniguchi et al. [20.03aj) . These 
gaps appear around A = 7110, 8160, 9210 A correspond- 
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ing to z« 4.8, z« 5.7 and zw 6.6 for LAEs. Particularly 
successful have been observations with the SuprimeCam 
of the Subaru telescope, leading, e.g., to the discovery of 
a large-scale structure at zw5.7 (Ouchi et al. I2005|l . The 
properties of the LAEs have also been used to derive the 
luminosity function of LAEs (Hu et al. 12004(1 . the star- 
formation rate in the early universe (Ajiki et al. '2 003(1 . and 
the epoch of re- ionization (Rhoads et al. l2004(l . However, 
so far, most detections of high-redshift LAEs have been 
based on relatively large area surveys sampling the in- 
trinsically luminous objects. Only a few studies have been 
devoted to faint LAEs at high redshift. Santos et al. 1(2004(1 
observed selected regions near intermediate-redshift clus- 
ters, finding eleven lensed low-luminosity LAEs between z 
= 2.2 and 5.6. Using a multi-slit technique, Martin et al. 
(IMl5|l find « 20 faint LAEs at z « 5.7. 

Although bright Lya galaxies are relatively easy to de- 
tect, their nature and physical structure is not understood 
well. Since Lya is a resonance line of the most abundant 
element, the mean free path of Lya photons in the inter- 
stellar matter is short and the photons diffuse in phys- 
ical and frequency space (Neufeld dOOO]) . Hence, there is 
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no straightforward correspondence between the properties 
of the Lya emission and the physical properties of the 
emitting galaxy. Moreover, dust affects the Lya photons 
more strongly than the UV-continuum photons, which are 
not subject to resonance scattering (Chariot & Fall 1993). 
As dust absorption depends on the presence of heavy ele- 
ments, one may expect to also find among the LAEs metal- 
poor or primordial matter galaxies with a stellar pop- 
ulation different from local objects (Malhotra &Rhoads 
I2()()2|l . Because of the complex physics of the high-redshift 
Lya emission galaxies, their relationship with the better- 
studied continuum-selected high-redshift galaxies (LBGs) 
(see, e.g., Shapley et al. I2003|l is not understood well 
(Ouchi et al. I2()()4|l . A detailed derivation and compari- 
son of the luminosity functions of LAEs and LBGs could 
help to clarify this relation. Furthermore, there are theo- 
retical predictions that photoionization heats and removes 
gas from the gravitational wells of galaxies during the re- 
ionization period. This may suppressed the galaxy forma- 
tion in low- mass halos (Barkana & Loeb ©99 ) . A break 
in the luminosity function might be a tool for deriving the 
halo mass where the star-formation is suppressed (Santos 
et al. 12004(1 and other parameters of the re-ionization 
epoch. 

We, therefore, carried out a search for intrinsically 
faint LAEs in the FORS Deep Field (FDF; Appenzeller 
et al. Onnni Hddt et al.[2DD3| Noll et aL I20Mjl . Since the 
FDF covers an area of 7 ' x 7', only a few of the bright Lya 
galaxies detected in most of the surveys quoted above can 
be expected to be found in the FDF. However, by extrap- 
olating the known part of the LF (Hu et al. 2004), we ex- 
pected (and verify with this paper) that a significant num- 
ber of intrinsically faint Lya emission galaxies are present 
in the FDF. A great advantage of the FDF with respect 
to other surveys is the availability of very deep broadband 
photometry and accurate photometric rcdshifts. The B, R, 
and I broad-band images have a limiting Vega magnitude 
(3cr in 2" diameter aperture) of 28.59, 27.99, and 27.21. 
These data allow a reliable discrimination between Lya 
galaxies and other emission line objects. 

Throughout this paper we use Vega magnitudes and 
adopt ^A = 0.7, Qm = 0.3, and Hq = 70 km s^^Mpc^^ 
The probed redshift of 5.630 < z < 5.803 results in a 
comoving volume of 1.5 x 10** Mpc"^. 

2. Photometric data 

2.1. Observations and data reduction 

LAEs are identified by their redshifted Lya emission with 
narrow-band imaging. The choice of the band-width of 
the narrow-band filter is a tradeoff between the sensi- 
tivity and the search volume (Maier et al. I2003|l . Three 
narrow-band filters placed in one atmospheric gap are a 
reasonable choice in terms of sensitivity and search vol- 
ume. Furthermore they have the advantage of determin- 
ing the continuum of the object near the emission line 
(Klaus Meisenheimer, priv. comm.). For the present study 



Table 1. Overview of the narrow-band observations. The 
ESO filter ID, their central wavelengths Ac, their band- 
width bw (FWHM) , the total integration time and the 50 
% completeness limit are given. 



Filter 


Ac 

[A] 


bw 

[A] 


Exp. time 

[s] 


50 % compl. 
[mag] 


F1LT_8 10.7+ 107 
F1LT_815_5+108 
F1LT_823.6+109 


8100 
8150 
8230 


69 
53 

55 


19800 
21240 
21240 


25.56 
25.63 
25.67 



we acquired three interference filters with bandwidths of 
about 60 A and central wavelengths of 8100 A, 8150 A, 
and 8230 A with high effective transmissions (w 93 %) 
for the F0RS2 multimode instrument at the ESO VLT. 
The three slightly overlapping filters fully cover the 8150 A 
window of the telluric OH emission. Any object with emis- 
sion lines in the wavelength range covered by the filters is 
expected to show an excess emission in one or (in cases 
where the emission coincides with an overlap wavelength) 
two of the filter bands. After completion of the present 
program, the filters are now publicly available. Their ESO 
designations are FILT_810_7+107, FILT_815_5+108, and 
FILT_823_6-|-109. In the following these designations will 
be abbreviated to F810, F815, and F823, respectively. 

All photometric observations were carried out in 
August 2003 in visitor mode with F0RS2 at the VLT- 
Yepun. The detector was a mosaic of two 2k x 4k MIT 
CCDs used in the 200kHz readout mode with low gain and 
2x2 binning. Each frame was integrated for 1800 s. The 
total integration times and other information are listed in 
Tabled The seeing varied between 0'.'5 and 0'.'8. 

The data were reduced using the codes and proce- 
dures described by Heidt et al. H2003|l . All images were 
smoothed to a common seeing of FWHM=0'.'78 and co- 
added signal-to-noise weighted. The photometric calibra- 
tion was done using standard stars with known spectra. 
The source detection was carried out on the co-added im- 
ages using SExtractor (Berlin & Arnouts ll996|l . with the 
same parameters as for the I-band images (for details see 
Heidt et al. I2003|l . The number of significantly detected 
objects was 4303 in F810, 4519 in F815, and 4675 in F823. 
SExtractor was also used to derive total fluxes and mag- 
nitudes of the detected objects. 50% completeness limits 
for point sources were calculated following Snigula et al. 
I)2()()2|l . using basic image and detection parameters. The 
completeness limits are listed in Tabled 

The three filter bands avoid the stronger OH emission 
features still present in the 8150 A OH window by having 
most of these lines coincide with the low-sensitivity wings 
of the narrow bands. Therefore, the background is low, 
and lower emission-line-fiux levels can be reached than 
is possible with a single narrow-band filter covering the 
8150 A OH window. Other factors contributing to the high 
sensitivity of the present survey are the small filter band 
widths, the high sensitivity of the F0RS2 CCD at 8150 A, 
and a better-than-average seeing during the observations. 
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Moreover, all narrow-band observations were made during 
the second half of the observing nights, when (due to the 
nocturnal decay) the OH airglow is on average weaker. 



2.2. Selection of the LAE candidates 

In order to find LAE candidates among the objects that 
were detected in the narrow band images we extracted in 
a first step all objects showing a statistically significant 
flux excess (relative to the other bands) in one or two of 
the three narrow band images. Objects that had been de- 
tected in several filter bands were regarded as having a 
significant flux excess if a flux difference larger than 3 a 
was found. As a next step we used the deep broad-band 
images, the FDF photometric catalog (Heidt et al. 2003), 
and the FDF photometric redshift catalog (Gabasch et al. 
I2UU4|I to eliminate objects with z < 5.7 where emission 
lines other than Lya coincided with our filter bands. In 
this way the great majority of the narrow-band excess ob- 
jects could be identified as foreground objects on the ba- 
sis of their reliably lower photometric (and in some cases 
spectroscopic) redshifts, blue flux, or too low an (R-I). The 
majority (85%) of the narrow-band excess objects showed 
a small narrow-band magnitude difference of < 1.2 mag. 
A significant fraction of these objects have narrow-band 
excess caused by continuum features (e.g. we found that 
cool stars can produce an excess flux in our narrow bands). 
Thus an excess flux in a narrow-band frame of 1.2 mag is 
required to select galaxies with a strong emission line. To 
select faint LAEs, we used for the final catalog of LAEs 
candidates the deep I-band image as a reference. About 
50% of the excess objects with a narrow-band magnitude 
difference of > 1.2 mag could be identified as [Oil] emitters 
at z = 1.2. Other narrow-band flux excess objects could 
be explained by [O III] or Balmer line emission. Among 
the narrow-band excess objects that could not be elimi- 
nated as LAE candidates was only one object listed in the 
Heidt et al. (2003) FDF photometric catalog. This object 
(FDF-2178, Zphot = 5.74) shows a marginally significant 
flux excess in the F823 filter and an R-I > 2.2. However, 
its flux in the F815 and F810 bands is too high to be con- 
sistent with the expected drop shortward of Lya. Hence 
we conclude that this object, although certainly a high 
redshift galaxy, is not a z = 5.7 LAE candidate. 

The final catalog of LAEs candidates was selected in 
the following way. First we selected all objects showing 
a 3 cr flux excess (relative to the other bands) in one or 
two of the three narrow-band images. The narrow-band 
excess objects have to satisfy the following criteria to be 
regarded as LAEs candidates: (1): NB < 25.7 mag, (2): 
I-NB > 1.2 mag, (3): no detection in the B band. Bright 
objects (I < 25.5 mag) had to fulfill the criterion (4a): R-I 
> 1.5 mag and faint objects the criterion (4b): no detec- 
tion in the R band. Fiffteen narrow-band excess objects 
meet the criteria (l)-(4) and are listed in Table [3 In the 
following the individual objects are referred to by their 
sequence number in this table. The magnitudes given in 



Table 12 are narrow-band magnitudes in the Vega system. 
Also included in Table 2 are Lya equivalent widths (EW) 
derived (as described in Sect. 4.3) from the photometric 
data and photometric and (where available) spectroscopic 
Lya line fluxes. The spectroscopic fluxes do not include 
corrections due to possible slit losses. Some of the objects 
in the table are visible on the FDF I-band and z-band 
images (however, in none of the bluer band images) but 
have I-band fluxes below the 5 cr limit. Therefore, none of 
objects in Table is listed in the Heidt et al. (,2003,1 FDF 
photometric catalog. 

From a visual control of other crowded regions of the 
narrow-band images, we regard it as unlikely that many 
LAE candidates have been missed by this selection crite- 
ria. Examples of the B, I, F810, F815, and F823 images 
are presented in Fig. 1. An atlas of all objects in Table 
2 in these filters is given in Fig. 9 (available in electronic 
form only). 

3. Spectroscopic data 

3.1. Observations and reduction 

Originally we planned to carry out a spectroscopic ver- 
ification of all LAE candidates in Table [21 using F0RS2 
in spectroscopic mode. Because of the high red efficiency 
of the F0RS2 detector and the F0RS2 VPH gratings, a 
spectroscopic detection of the Lya flux (as estimated from 
the narrow-band data) of all our LAE candidates can be 
achieved with a modest amount of observing time with 
this instrumentation. An adequate amount of service ob- 
serving time was granted for this program by the ESO 
OPC in 2004. However, due to the pressure of higher pri- 
ority programs only a small fraction of our priority B pro- 
gram could actually be executed in November 2004. An 
application for additional time to complete the program 
was not successful. 

For the spectroscopic observations obtained in 
November 2004, we used the holographic grism 1028z, cov- 
ering the wavelength range 7800 - 9300 A at a resolution 
(with a 1" slit width) of R « 2700 (Av w 110 kms^^). This 
resolution allows a good subtraction of weak OH lines and 
a reliable identification of foreground [O II] emission ob- 
jects (see Fig. 2i). To observe all 15 objects with an ade- 
quate S/N, three different MOS masks had been prepared, 
with the intention of exposing each mask for three hours. 
By including the fainter objects in all three masks, while 
the brighter targets were included in only one mask, it 
was planned to detect all targets with an adequate SNR. 
For the reasons described above, only one mask could be 
exposed with total integration time of 2.7 h only. 

The spectra were reduced using MIDAS and the rou- 
tines developed by Noll et al. l|2()()4|l . The two-dimensional 
spectra were corrected with a dome flatfield and were 
wavelength-calibrated using the calibration spectra of 
gas discharge lamps. After the extraction of the one- 
dimensional spectra, a flux calibration was carried out us- 
ing spectra of standard stars observed during the same 
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Table 2. Photometric and spectroscopic properties of the 15 LAE candidates. The hmits of the narrow-band photom- 
etry correspond to the limiting magnitude {3a in 2" diameter aperture). 



Nr. 


RA 


DEC 


maggio 


magsis 


niag823 


Fluxphot 
[10-21 Wm-2] 


EW [A] 


•^spcc 


FluXspoc 

[10-21 Wm-2] 


1 


1:05:50.36 


-25:46:31.30 


> 26.35 


> 26.46 


25.03 ± 0.11 


5.41 ± 0.55 


> 70.1 


5.780 


8.36 ± 0.83 


2 


1:05:51.06 


-25:43:21.50 


25.28 ± 0.16 


24.75 ± 0.09 


> 26.48 


5.02 ± 0.37 


> 99.5 


- 


- 


3 


1:05:52.24 


-25:47:10.24 


> 26.35 


> 26.46 


25.12 ± 0.14 


4.98 ± 0.64 


> 61.8 


5.770 


2.41± 0.49 


4 


1:05:52.45 


-25:43:52.50 


> 26.35 


> 26.46 


24.61 ± 0.10 


7.97 ± 0.73 


> 131.5 


- 


- 


5 


1:05:53.42 


-25:44:26.42 


> 26.35 


> 26.46 


24.88 ± 0.10 


6.22 ± 0.57 


> 86.9 


- 


- 


6 


1:05:54.94 


-25:48:25.08 


> 26.35 


> 26.46 


25.14 ± 0.15 


4.89 ± 0.68 


> 60.1 


5.787 


8.17 ± 1.02 


7 


1:05:58.45 


-25:42:41.17 


24.73 ± 0.10 


> 26.46 


> 26.48 


9.02 ± 0.83 


> 161.4 


- 


- 


8 


1:05:59.27 


-25:49:20.37 


24.82 ± 0.11 


> 26.46 


> 26.48 


8.30 ± 0.84 


> 138.0 


5.627 


4.79± 0.56 


9 


1:06:01.46 


-25:44:25.45 


25.16 ± 0.13 


> 26.46 


> 26.48 


6.07 ± 0.73 


> 80.7 


- 


- 


10 


1:06:06.05 


-25:43:17.68 


> 26.35 


> 26.46 


25.69 ± 0.19 


2.95 ± 0.52 


> 28.4 


- 


- 


11 


1:06:07.82 


-25:48:49.86 


> 26.35 


> 26.46 


25.07 ± 0.13 


5.22 ± 0.62 


> 66.3 


5.758 


1.13 ± 0.33 


12 


1:06:07.93 


-25:43:17.47 


> 26.35 


24.26 ± 0.05 


> 26.48 


10.59 ± 0.49 


> 230.1 


- 


- 


13 


1:06:08.88 


-25:48:37.24 


> 26.35 


24.83 ± 0.11 


> 26.48 


6.26 ± 0.63 


>88.4 


5.679 


4.37 ± 0.50 


14 


1:06:09.38 


-25:48:20.32 


> 26.35 


> 26.46 


25.00 ± 0.15 


5.57 ± 0.77 


> 73.1 


5.764 


4.05 ± 0.54 


15 


1:06:16.29 


-25:48:06.58 


24.1 ± 0.05 


> 26.46 


> 26.48 


16.12 ± 0.74 


> 872.4 


5.640 


11.99 ± 0.72 
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(b) 

Fig. 1. Bessel-R, Bessel-I broad-band images and F810, F815, and F823 narrow-band images of 2 examples of our 
targets: (a) The second brightest candidate (No. 12) . (b) Object with an intermediate flux and visible in two narrow- 
band filters, although it was significantly detected only in the F815 filter (No. 13). Each image shows a 10" x 10" 
area centered on the target. 



night. The one-dimensional spectra were then co-added. 
Since the efficiency of VPH grisms varies with the angle 
of incidence and thus with the object's position in the 
telescope focal plane (see Tapken f2()()5|l . the fluxes were 
corrected for this using the sky-background. For 8000 - 
8200 A, this effect was below 10 % for most spectra. 

3.2. Spectroscopic results 

The single MOS mask for which data could be obtained 
included eight of the LAE candidates of Table |21 and sev- 



eral calibration and reference objects. In spite of the short 
exposure time, line emission from all of these eight LAE 
candidates was detected. In each case only one single emis- 
sion line was observed. Figure |21 shows the observed line 
profiles. Since all objects in Table 2 show only weak or no 
detectable continua, which could provide independent in- 
formation on the redshift, we verified that our spectra do 
not contain additional emission lines that were expected in 
the case that the observed features were due to redshifted 
[O III] or Balmer lines. Moreover, none of the profiles has 
the structure expected for the [O II] 3727 A doublet. This 
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doublet has a rest-frame separation of 2.8 A, leading to 
an observed doublet separation of w 6 A, allowing for an 
easy separation at our resolution. As an example at the 
end of Fig. El we include the [O II] doublet of FDF-7757 
(zphot = 1.22) observed during the same run. Only our 
LAE candidate No. 13 shows an apparent (but not signifi- 
cant) doublet structure of the expected width. However if 
this line was indeed [O II] , the doublet ratio would hardly 
be consistent with the theoretically allowed range of values 
(OsterbrockHnHnil- 



4. Properties of the LAE candidates 

4.1. Spatial and redshift distribution 

Figure 121 shows the spatial distribution of our LAE candi- 
dates. The objects are clustered at the edge of the field, 
while the center seems to be avoided. We verified that this 
distribution is not caused by reduction problems by com- 
paring the limiting magnitudes in the de- voided area with 
the limiting magnitude in the area containing the objects. 
Our sample is too small to verify that this distribution de- 
viates significantly from a random distribution. However, 
our result is consistent with the data of Hu et al. I|2()()4|l 
covering of a w 10 times larger volume, who find evidence 
for large-scale structure of the bright LAEs distribution 
and Wang et al. H2(JU5|I . who find an overdensity of LAEs 
in the Chandra Deep Field South. 

The distribution of spectroscopic redshifts within the 
observational window is given in Fig. 01 A high fraction of 
F823 candidates were included in the mask observed, thus 
most of the redshifts in Fig. ^ are clustered at z ?» 5.76. 



3 






5.5 



5.6 



5.7 
Redshift z 



5.8 



5.9 



(a) 



Fig. 4. Distribution of redshifts of the eight LAE candi- 
dates observed spectroscopically. 



4.2. Fluxes and star-formation rates 

The line fluxes are derived using the narrow-band pho- 
tometry. In Fig.[Slthe distribution of fluxes is shown. The 
fluxes range from 3 x 10~^^Wm~^ to 16 x 10~^^Wm~^. 
All fluxes are below the flux limit of Hu et al. H2l)U4|l of 
20 X 10-2iWm-2. 








1 1 1 1 



5 10 15 

Lya flux [10-21 Wm-2] 

Fig. 5. The distribution of the photometric line fluxes of 
the 15 LAE candidates. 



From the flux of the Lya line we computed star- 
formation rates. The line luminosities are derived by as- 
suming a cosmology model ( J7a = 0.7, SIm = 0.3, and Hq 
= 70 km s^^Mpc"^) and isotropic emission. To derive the 
star-formation rates, the calibration of Kennicutt H1998[l ^ 
was used and Case B recombination was assumed. In Fig. 
Othe distribution of the star-formation rates is given. The 
star-formation rates derived from the line fluxes are be- 
tween 1 and 5 MQyr"^. As pointed out above, part of the 
Lya may be lost by dust absorption. Moreover, the inter- 
galactic medium probably absorbs a fraction of the Lya 
photons. Hence the observed line luminosity and thus the 
star-formation rates are only lower limits. In addition, the 
conversion of line luminosity into star-formation rates de- 
pends on assumptions of the starburst properties and the 
IMF. 

4.3. Equivalent widths 

Using the I-band and the narrow-band photometric re- 
sults, we tried to calculate Lya equivalent widths or lower 
limits for all our LAE candidates. For this task we used 
the procedure described by Hu et al. (2004) . This approach 
based on the assumption of a rectangular filter shape of 
the I-band and the assumption that the I-band flux rep- 
resents the continuum. The latter may be a poor approx- 
imation in our case. We re-measured the I-band magni- 
tudes for all LAE candidates using aperture photometry. 



^ Kennicutt H1998|l assumes a Salpeter initial mass function 
in the mass range of 0.1 to 100 M©, solar metalicity, and a 100 
Myr old starburst with continuous star-formation. 
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Fig. 6. The distribution of the star-formation rates de- 
rived from the photometric hne fluxes. 



and Cwavc are greater than 1, i.e., are extended to the 
red in good agreement with the results of Dawson et 
al. (20025), who mainly analysed galaxies with z > 4 . 
Moreover, Dawson et al. H2(JU4|I found for 28 galaxies at 
z « 1 asymmetry parameters of the [Oil] AA3726.2, 3728.9 
line of Cwavc and asux ~ 1. In our sample FDFLAE-15 has 
the strongest asymmetry with Oflux = 3.91 ± 0.57 and 
flwavc = 1-64 ± 0.26. A composite spectrum formed by 
simply adding all our individual profiles is shown in Fig. 
Obviously this composite also shows a marked asym- 
metry in the expected sense. 

From the discussion above, we conclude that at least 
our LAE candidates with a spectroscopic confirmation are 
indeed LAEs at z = 5.7. The high success rate of our 
spectroscopic verifications suggests that at least the great 
majority of our all LAE candidates are LAEs at z « 5.7. 



Although several objects are visible on the I-band image, 
only four were marginally detected with 2 < cr < 3. For all 
objects, the three sigma detection limit in a 2" diameter 
aperture was used as an upper limit for the continuum. In 
Table El we list the resulting rest-frame equivalent widths 
and lower limits. As shown by the table, all objects have 
rest- frame equivalent widths >20 A. 

4.4. Line profiles 

All observed line widths of our LAEs are below 300 
kms^^. This agrees with other spectroscopic studies of 
high-redshift LAEs (Dawson et al. I2004|l . High-redshift 
LAEs have also be identified in the literature on the ba- 
sis of asymmetric line profiles, typically showing a sharp 
drop in the blue wing and an extended red wing (Dawson 
et al. l2()()2|l . Kunth et al. also (199H|l observed asymmetric 
Lya profiles also in nearby star-forming galaxies. Hu et 
al. H2004II modeled the composite profile of 19 LAEs with 
a Gauss emission profile and a Voigt absorption. They at- 
tributed the absorption to the intergalactic medium. Most 
line profiles in Fig. |21 also show an asymmetry. 

To quantify the asymmetry we used the parameters 
introduced by Rhoads et al. H2003|l aflux and Owavc- Owavc 
gives the wavelength ratio and asux the flux ratio of the 
blue and red part of the Lya profile: 
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Here, Apeak is defined as the wavelength of the peak of the 
emission. Aio^b (Aio,r) is defined as the wavelength where 
the flux reaches 10 % of his peak flux level on the blue 
(red) side. 

For six lines we could measure the values of aflux and 
Owave- Except for FDFLAE-13, all objects show that aflux 
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Fig. 7. Composite spectra of the eight emission line ob- 
jects. The dotted line is the instrumental profile, derived 
from the sky lines. 



n\ 4.5. The luminosity function 



Using the observed density of our LAE candidates in the 
FDF and assuming (for the reasons given above) that all 
these objects are LAEs, we can use the data of Table 2 to 
derive the surface and space density of the low-luminosity 
LAEs as a function of the luminosity (i.e. the LF). In or- 
der to avoid uncertain incompleteness corrections, we used 
for this purpose only those objects in Table 2 that have 
narrow-band magnitudes brighter than the 50 % com- 
pleteness limit (14 of the 15 LAEs). The results are given 
in Fig. |51 together with the published luminosity func- 
tion of Hu et al. H2004|l and Ajiki et al. (2003) . Hu et 
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al. H2UU4|I used deep narrow-band imaging of the SSA22 
field to search for 19 LAEs at a redshift of z—5.7. They 
detected 26 candidates down to a limited flux of 20 x 
10~^^Wm~^. Spectroscopic observations showed a high 
succes rate. Ajiki et al. ('2003} found 20 LAE candidates 
at a redshift of z=5.7 with the Suprime-Cam. As shown 
by the figure, our luminosity function is consistent with a 
continuation of the Hu et al. and Ajiki et al. luminosity 
function towards lower luminosities. Malhotra & Rhoads 
l|2()()4|l assembled data from several narrow-band LAEs 
surveys at a redshift of z « 5.7 and derived a Schechter 
function {a = - 1.5, L* = lO^^ W, $^ = 10"^ Mpc'^) 
included in Fig. |21 Wc find more LAE candidates than 
expected on the basis of this luminosity function. 

We also included in Fig.|Hlthe luminosity function from 
Kudritzki et al. (I^HTinjl and Cowie & Hu ()TM^ . Kudritzki 
et al. H2U0U(I and Cowie & Hu H1998|l used the narrow- 
band technique to detect LAEs at a redshift of z=3.1 (3.4). 
Their results are largely consistent with the higher redshift 
luminosity function. Moreover, we included the Schechter 
function for Lya emitters with 2.3 < z < 4.6 (mean 
z = 3.18) derived by van Breukelen et al. H2()()5|l . Van 
Breukelen et al. lpKI5|l detected 14 LAEs using VIMOS 
IFU spectroscopy. Their Schechter function is consistent 
with our results. 

We also compared our number counts with the predic- 
tion of Thommes & Meisenheimer ()2()()5|l . who compute 
the expected surface density of Lya emitting galaxies on 
the assumption that LAEs are the progenitors of today's 
elliptical galaxies and bulges of spiral galaxies. One of the 
main assumptions of this model is a short Lya bright 
phase of the star-forming galaxies. This short duration 
of the Lya bright phase is explained by the rapid forma- 
tion of dust in this galaxies. The basic model of Thommes 
& Meisenheimer (|2005|l predicts a number of « 20 LAEs 
with LLya > 10^^ W in the FORS Deep Field at a redshift 
of z^ 5.7. Given the large uncertainity, this agrees with 
the observed number of 15. 

5. Conclusions 

Our survey has shown that F0RS2, the ESO VLT, and our 
special filter set make it possible to extend groundbased 
searches for Lya emission galaxies at z = 5.7 to signif- 
icantly lower luminosities. Although the lack of observ- 
ing time did not allow a full spectroscopic verification of 
all objects detected by our narrow-band filter survey, the 
available spectroscopic results indicate a high success rate 
of this set-up. The observed faint LAEs show very similar 
properties to those observed at higher luminosities. A lu- 
minosity function constructed on the assumption that all 
our photometrically detected emission objects are LAEs 
at z = 5.7 is in good agreement with the LF published 
by Hu et al. (20^1 and extends the Hu et al. luminosity 
function towards lower luminosities. 
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Fig. 8. Luminosity function derived from the photometric 
data (filled squares). Two surveys at a redshift of z = 5.7 
have been included: circles correspond to Hu et al. I)2004|l 
and open squares to Ajiki et al. H2003|l . Two surveys at a 
redshift of z« 3.2 are also included: triangles correspond 
to Kudritzki et al. (2000;), crosses to Cowie & Hu (1998). 
Moreover, a Schechter function (Breukelen et al. .2005^1 
for Lya emitters with 2.3 < z < 4.6 (solid line) and a 
Schechter function (Malhotra & Rhoads 2004) for LAEs 
at zRi 5.7 (dotted line) arc plotted. The error bars denote 
statistical mean errors. 
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Fig. 2. Observed emission line profiles of the LAE candidates. For comparison the [Oil] 3727 doublet of FDF-7757 at 
Zphot = 1-22 is also included. 
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Fig. 3. The spatial distribution of the narrow- line excess objects in the FDF (shown is a deep I-band image). Circles 
correspond to objects found in the narrow-band nbSlO, triangles to objects detected in the narrow-band nb815, and 
crosses to objects found in the narrow-band nb823. North is up, east is left. The field is 7 x 7 arcminutes large, which 
corresponds to 2.5 Mpc x 2.5 Mpc (physical) or 17 Mpc x 17 Mpc (comoving). 



